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ANALOG SIGNAL INPUT/OUTPUT SYSTEM USING NETWORK LINES 
BACKGROUND OF THE INVENTION 

T e chnical Field 

(1) Field of the Invention 
[0001] 

The present invention relates to a system that inputs and outputs analog 
electrical signals through computer network links and, more particularly, to an 
arrangement in which an analog signal input/output device performs analog-to-digital 
and digital-to-analog conversions. 

Background Art 

(2) Description of the Related Art 
[0002] 

When voice is input from and output to a personal computer, a driver in the 
operating system is typically used from an application that handles sound to enable a 
sound card. In a known arrangement, the sound card is equipped with a speaker 
terminal and a microphone terminal; the speaker terminal is used to output voice from 
the computer to the speaker, and the microphone connected to the microphone terminal 
is used to enter voice. 
[0003] 

Particularly, recent personal computers incorporating a CD drive and a DVD 
drive are widely used to reproduce multi-media information on the computer or to 
reproduce music contents and video contents downloaded from a network. 
[0004] 

Widespread use of the Internet, local area networks (LANs), and the like has 
also enabled constant connection of a personal computer to the networks and 
communication with computers and devices on the networks. 

When voice is output from the computer in this environment, the 
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above-mentioned arrangement in which devices are connected to the speaker terminal 
and microphone terminal has restrictions on the installation place and the distance to the 
computer. Another problem is that a plurality of devices cannot be selectively handled 
unless a plurality of terminals are provided. 
[0005] 

Since home wireless LANs are becoming widespread and freedom in the usage 
environment, such as for notebook computers, is being increased, devices are preferably 
connected to the notebook computers via a network. 
[0006] 

Printers and scanners, for examples, are already provided with a wireless LAN 
adapter, so they are widely shared by computers connected to a wireless LAN. All of 
this type of printers and scanners are devices that handle digital signals having a high 
affinity with networks and not devices that input and output analog signals. 
[0007] 

Voice data may be sent to a remote computer through a network, and the 
computer outputs the data as voice. This arrangement is used between dedicated 
terminals in a videophone system or the like. This arrangement is, however, not 
available for connecting an existing computer to an analog device, so its versatility is 
low. 
[0008] 

General-purpose devices that freely accept analog signals and have them 
processed by a computer are not provided. There is a desire for a device that can freely 
input not only voice but also analog signals obtained by measuring instruments and the 
like into a computer. 
[0009] 

In a conventional known example disclosed in Japanese unexamined patent 
application No. 2003-316375, voice is coded by a terminal and sent to a host computer; 
the host computer then decodes the coded voice for voice recognition and returns the 
result to the terminal. Technique to use a general-purpose personal computer as the 
terminal and have data processing with a high load performed by the host computer, as 
described above, is known. 

Patent Document 1 : Japanese unexamined patent application No. 2003-3 1 6375 
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[0010] 

In the above method, however, there is no need to strictly transfer obtained 
voice data without a delay, so, in practice, any technology for transferring measured data 
and voice data in real time is not disclosed. 
[0011] 

Japanese unexamined patent application No. 2003-163703 discloses a network 
address translation device that enables heavy voice communications to be established 
simultaneously between different networks. According to the disclosure, upon receipt 
of a call setting request, a network address translation (NAT) control unit, which 
performs address translation, creates a new voice transmission port. The primary 
purpose of the NAT control unit is to create voice transmission ports on two different 
networks so that voice communication can be carried out between them, so it is assumed 
that one socket is used for control and another socket is used for a large amount of voice 
communication. The two sockets are only selectively used. Various types of control 
information cannot flow in the control socket during voice communication. When the 
method of coding analog signals is changed or the method of reproducing the signals is 
controlled, therefore, a socket dedicated to analog signal transmission must be provided 
for a signal that changes the coding method or controlling the reproduction method. 
Patent Document 2: Japanese unexamined patent application No. 2003-1 63703 
[0012] 

There is also a problem in analog signal input/output; it is difficult to 
immediately reflect characteristic information indicating the characteristics of the analog 
signal in the processing at the communication destination. If the analog signal is a 
voice signal, for example, when a voice level, a sampling rate, the number of bits per 
sample, and other characteristic information cannot be sent immediately to the device at 
the communication destination, serious failures may occur during reproduction or 
recording. 
[0013] 

When signals are sent and received via a network, delays may be caused 
depending on the network situation, so the reliability with which analog signals are 
processed without a delay is low. Particularly, when stereo voice is simultaneously 
output from devices on a network, delays may be caused and accumulated separately. 
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When this happens, voice may become completely out of phase. 

Summary of th e Inv e ntion 

Probl e ms to b e Solved by th e Inv e ntion 

BRIEF SUMMARY OF THE INVENTION 

[0014] 

The present invention addresses the problems with the conventional 
technologies described above with the object of providing an analog signal input 
terminal that converts received analog signals to digital signals and sends the digital 
signals to a host computer via a network as well as an arrangement in which digital 
signals generated by the host computer are sent to an analog signal output terminal and 
the digital signals are converted to analog signals by the terminal and then output. 
M e ans of Solving th e Probl e ms 
[0015] 

In the background of the conventional technologies, the present invention was 
devised; it provides means described below. 
[0016] 

The invention d e scrib e d in claim 1 is an analog signal input system that uses an 
analog signal input terminal to convert analog signals into digital signals and send the 
converted digital signals to a host computer via a network; the analog signal input 
terminal has at least an input unit for accepting analog signals, an A/D converter for 
converting the analog signals into digital signals, a network controller for controlling 
data transmission and reception, to which an Internet protocol (IP) connection is possible, 
a terminal-side IP connection establishing unit for establishing two connections, that is, 
an inbound socket connection and an outbound socket connection, to and from the host 
computer, a control signal processing unit for receiving control signals related to at least 
a start request and a stop request from the host computer, and a signal transmitting unit 
for sending digital signals according to the control signals. 
[0017] 

The host computer has at least a network adapter for controlling data 
transmission and reception, to which an IP connection is possible, a host-side IP 
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connection establishing unit for establishing two connections, that is, an inbound socket 
connection and an outbound socket connection, to and from the analog signal input 
terminal, a control signal processing unit for sending control signals related to at least a 
start request and a stop request to the analog signal input terminal, an application 
processing unit for executing an application and allowing the application to use the 
above digital signals, and an IP connection disconnecting unit for disconnecting the 
inbound socket connection and the outbound socket connection. 
[0018] 

In the inventive analog signal input system a d e scrib e d in claim 2, the 
terminal-side IP connection establishing unit in the analog signal input terminal 
establishes an inbound socket connection to the host computer when it detects an 
outbound socket connection from the host computer, and the host-side IP connection 
establishing unit in the host computer establishes an outbound socket connection to the 
analog signal input terminal. 
[0019] 

In the inventive analog signal input systen^ d e scribed in claim 3, the analog 
signal input terminal is provided with a microphone, from which output signals are input 
into the input unit for accepting input signals, enabling voice to be retrieved through the 
network. 
[0020] 

In the inventive analog signal input system 1 d e scrib e d in claim 4 , the network is 
a wireless communication network; the network controller and network adapter are 
compatible with the wireless communication network. 
[0021] 

In th e invention d e scrib e d in claim 5, the The network uses the user datagram 
protocol (UDP) to include an IP packet at the time of the IP connection in a UDP packet 
and also include characteristic information data related to the signal contents of the 
digital signal retrieved in a header field in the UDP protocol so as to send the IP packet 
and characteristic information data. 
[0022] 

In the inventive analog signal input system, d e scrib e d in claim 6, the analog 
signal is a voice signal and the characteristic information data is at least any one of a 
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voice level, a sampling rate, and the number of bits per sample. 

The present invention can also provides an analog signal output terminal 
described below. 
[0023] 

That is, th e The invention d e scrib e d in claim 7 is an analog signal output system 
in which digital signals are sent from a host computer to an analog signal output terminal 
through a network and the analog signal output terminal converts the digital signals into 
analog signals and then outputs the analog signals; the analog signal output terminal has 
at least a network controller for controlling data transmission and reception, to which an 
Internet protocol (IP) connection is possible, , a terminal-side IP connection establishing 
unit for establishing two connections, that is, an inbound socket connection and an 
outbound socket connection, to and from the host computer, a control signal processing 
unit for receiving control signals related to at least a start request and a stop request from 
the host computer, a signal receiving unit for receiving digital signals according to the 
control signals, a D/A converter for converting the digital signals into analog signals, and 
an output unit for outputting the analog signals. 
[0024] 

The host computer has at least a network adapter for controlling data 
transmission and reception, to which an IP connection is possible, a host-side IP 
connection establishing unit for establishing two connections, that is, an inbound socket 
connection and an outbound socket connection, to and from the analog signal output 
terminal, a control signal processing unit for sending control signals related to at least a 
start request and a stop request to the analog signal output terminal, an application 
processing unit for executing an application and causing the application to generate 
digital signals, a signal transmitting unit for sending the generated digital signals, and an 
IP connection disconnecting unit for disconnecting the inbound socket connection and 
the outbound socket connection. 
[0025] 

In the inventive analog signal output system A d e scrib e d in claim 8, the 
terminal-side IP connection establishing unit in the analog signal output terminal 
establishes an inbound socket connection to the host computer when an outbound socket 
connection from the host computer is detected, and the host-side IP connection 
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establishing unit in the host computer establishes an outbound socket connection to the 

analog signal output terminal. 

[0026] 

In the inventive analog signal output system^ d e scrib e d in claim 9, the analog 
signal output terminal has a buffer area and data requesting unit; the data requesting unit 
sends a data transmission request signal according to the storage capacity of the buffer 
area; the signal transmitting unit in the host computer sends digital signals according to 
the transmission request signal. 
[0027] 

In th e inv e ntion describ e d in claim 10, a A speaker is provided on the analog 
signal output terminal; the output signals from the output unit are generated as output 
signals as voice from the speaker, enabling voice to be output through the network. 
[0028] 

In the invention, d e scrib e d in claim 11, the network is a wireless 
communication network; the controller and network adapter are compatible with the 
wireless communication network. 
[0029] 

The invention d e scrib e d in claim 12 provides an arrangement in which the 
network uses the user datagram protocol (UDP) to include an IP packet at the time of the 
IP connection in a UDP packet and also include characteristic information data related to 
the signal contents of the digital signal retrieved in a header field in the UDP protocol so 
as to send the IP packet and characteristic information data. 
[0030] 

In the inventive analog signal output systen^ d e scrib e d in claim 13, the analog 
signal is a voice signal and the characteristic information data is at least any one of a 
voice level, a sampling rate, and the number of bits per sample. 
[0031] 

In the inventive analog signal output system^ d e scribed in claim 1 4 , the analog 
signal output terminal has a buffer with a prescribed capacity, which is used to store the 
digital signals received by the signal receiving unit; the analog signal output terminal 
also has at least a monitoring unit for monitoring the amount of digital signals stored in 
the buffer or the remaining capacity of the buffer and a synchronization control unit for 
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changing a sampling clock in the D/A converter according to the either the amount of 
digital signals stored or the remaining capacity; the analog signal output by the output 
unit is then synchronized. 
[0032] 

The invention^ d e scrib e d in claim 1 5, in which the analog signal output system 
has two or more analog signal output terminals for one host computer, provides a 
technology by which two or more types of voice data, including right and left stereo 
channel voice data, are output to each analog signal input terminal and by which voice 
outputs from the two or more analog signal output terminals are mutually synchronized 
by the function of the synchronization control unit. 
[0033] 

In the inventive analog signal output system^ d e scrib e d in claim 16, a remote 
operation terminal for remotely operating an output mode from the analog signal output 
terminal is provided on the network; the host computer and remote operation terminal 
are interconnected through an operation socket that is different from the above two 
connections, that is, the inbound socket connection and outbound socket connection; 
when the remote operation terminal sends a remote operation signal to the host computer, 
the network adapter in the host computer receives the remote operation signal and then 
the control signal processing unit sends a control signal according to the remote 
operation signal. 
Eff e cts of th e Inv e ntion 
[0034] 

According to the means described above, an analog signal input terminal that 
converts received analog signals to digital signals and sends the digital signals to a host 
computer via a network is used, and digital signals generated in the host computer are 
sent to the analog signal output terminal through the network to have the analog signal 
output terminal convert the digital signals into analog signals and output them, enabling 
voice, measured data, and the like to be transmitted in real time even between remote 
sites. Furthermore, since a synchronization control mechanism is provided, phase 
discrepancies do not occur even in stereo voice. 
Brief Description of th e Drawings 
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BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS 



[0035] 

FIG. 1 shows the entire structure of an analog signal input/output system 
according to the present invention. 

FIG. 2 illustrates the functions among the modules in the system according to 
the present invention. 

FIG. 3 shows the structure of an analog signal input system according to the 
present invention. 

FIG. 4 shows the structure of an analog signal output system according to the 
present invention. 

FIG 5 shows an operation sequence indicating the flow of data during 
recording. 

FIG. 6 shows an operation sequence indicating the flow of data during 
reproduction. 

FIG. 7 illustrates buffer management in the analog signal input/output system 
according to the present invention. 

FIG 8 illustrates a data transmission procedure during recording. 

FIG. 9 illustrates a data transmission procedure during reproduction. 

FIG 10 shows the entire structure of an analog signal input/output system in a 
second embodiment in the present invention. 

FIG 1 1 illustrates sockets in the analog signal input/output system in the second 
embodiment in the present invention. 

FIG. 12 illustrates the structure of voice data. 

FIG. 13 is a block diagram of the analog signal input/output system in the 
second embodiment of the present invention. 

FIG. 14 is a block diagram of a voice processing circuit in the second 
embodiment of the present invention. 

FIG 15 shows the entire structure of an analog signal input/output system in a 
third embodiment of the present invention. 
Explanation of reference charact e rs 
4-& — Hoot computer 
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11: Application 

20: Network 

21: Outbound sockot 

22r. — Inbound socket 

30r — Analog signal input/output d e vice 

31: Analog signal input t e rm inal 

iQr. — Analog signal output t e rminal 

33: AID converter 

Mi — D/A convert e r 

At — P e rsonal comput e r 

ft — tfek 

B e st Mod e for Carrying Out th e Invention 

DESCRIPTION OF THE PREFFERED EMBODIMENTS 

[0037] 

Preferred embodiments of the present invention will be described with reference 
to the drawings. The embodiments of the present invention are not limited to the 
following, but can be varied as appropriate. 
[0038] 

FIG. 1 shows the entire structure of an input/output system for analog signals 
according the present invention (the system is referred to below as this system). 
[0039] 

This system comprises a host computer 10 and an analog signal input/output 
device 30 that is a terminal capable of performing communication through a network 20. 
The host computer executes an application 1 1 that performs desired processing by using 
analog signals received and output. 
[0040] 

The interface of the network uses a transmission control protocol/Internet 
protocol (TCP/IP) socket method. Two sockets are provided; an outbound socket 21 
specific to outbound information and an inbound socket 22 specific to inbound 
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information. The direction from the host computer to the analog input/output device is 

the outbound direction, and the reverse direction is the inbound direction. 

[0041] 

The analog signal input/output device 30 has an analog signal input terminal 31 
and analog signal output terminal 32, which are connected to an AID converter 33 and 
D/A converter 34, respectively, in the analog signal input/output device 30. 
[0042] 

The host computer 10 is preferably a personal computer A. The analog signal 
input/output device 30 is configured as a dedicated unit B; the unit may be included in a 
communication device such as a router or in a device that inputs and outputs analog 
signals such as a measuring instrument, speaker, or microphone. 
[0043] 

The network 20 may be of any type if it can use the TCP/IP socket method, but 
the Internet and wired and wireless local area networks (LANs) are preferable. 
[0044] 

In this system, the analog signal input system and the analog signal output 
system can be configured separately, according to the usage purpose. 
First Embodiment 
[0045] 

In an arrangement disclosed below, a speaker and a microphone are provided on 
the analog signal input/output device 30; voice reproduced by the personal computer is 
output from the speaker: voice is input from the microphone and used on the personal 
computer. 
[0046] 

FIG. 2 illustrates the functions of the hardware modules and software modules. 

[0047] 

On the personal computer, a virtual sound driver 41 receives various settings, 
commands, and data sent from a high-order application 40 being executed to a sound 
driver; they are then stored temporarily in a buffer driver 42; setting software 43 accesses 
the buffer driver 42 and inputs and outputs necessary data to and from the analog signal 
input/output device. 
[0048] 
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The virtual sound driver transmits and receives data to and from the buffer 
driver through data input/output functions, in response to commands for reproduction, 
recording, stopping, and other operations as well as various settings. 
[0049] 

The buffer driver is configured as a simple driver having a wave data storage 
area, a data input/output function (IOCTL), and an event notification feature to 
compensate for the inability of the virtual sound driver and setting software to directly 
input and output data. 
[0050] 

The setting software is an application which, upon receipt of a notification from 
the buffer driver, acquires data necessary for reproduction and recording according to the 
state change and carries out communication with the analog signal input/output device. 
[0051] 

FIGs. 3 and 4 show the structures of an analog signal input system and analog 
signal output system, respectively, according to the present invention. , These systems 
are shown separately for a better understanding of the input and output structures. In 
the actual embodiment, however, they are combined into one. 
[0052] 

In the input system shown in FIG 3, the personal computer 50 has a network 
adapter 51 connected to the network and also includes an IP connection establishing unit 
52 on the host side, a control signal processing unit 53, an IP connection disconnecting 
unit 54, and an application processing unit 55, centered around the network adapter 51. 
[0053] 

The IP connection establishing unit 52 establishes two connections, an inbound 
socket connection and an outbound socket connection, to and from an analog signal 
input device 60. The control signal processing unit 53 sends control signals to the 
analog signal input device, as described in detail below. The IP connection 
disconnecting unit 54 disconnects the inbound socket connection and outbound socket 
connection after input has been completed. 
[0054] 

The application processing unit 55 performs software processing for the sound 
application 40, virtual sound driver 41, buffer driver 42, and setting software 43 which 



12 



are shown in FIG 2. The network adapter 5 1 comprises a known LAN card and its 
driver software. The other processing units 52 to 55 use the CPU mounted in the 
personal computer as well as a memory, peripheral storage unit, or other units that 
operate in conjunction with the CPU to perform processing. 
[0055] 

The analog signal input device 60 has a network controller 61 connected to the 
network and also includes an IP connection establishing unit 62 on the terminal side, a 
control signal processing unit 63, an analog signal input unit 64 for accepting analog 
signals, an AID converter 65 for converting the analog signals into digital signals, and a 
signal transmitting unit 66 for transmitting digital signals according to a control signal, 
centered around the network controller 61. 
[0056] 

The network controller 61 has an IP connection with the above-mentioned 
network adapter 5 1 . Both the network controller 6 1 and IP connection establishing unit 
62 comprise, for example, known IC circuits. The control signal processing unit 63 
receives a control signal from the host computer to control signal transmission by the 
signal transmitting unit 66. 
[0057] 

A microphone is connected to the analog signal input unit 64; analog input 
signals from the microphone are converted into digital signals. Since A/D conversion 
technique is known, it can be practiced with ease by using, for example, a dedicated IC 
chip. 
[0058] 

In the output system shown in FIG. 4 as well, the personal computer 50 has a 
network adapter 51 connected to the network and also includes an IP connection 
establishing unit 52 on the host side, a control signal processing unit 53, an IP connection 
disconnecting unit 54, and an application processing unit 55, centered around the 
network adapter 5 1 . The components in the output system that are identical to the 
counterparts in the above input system are indicated by the same reference numerals. 
[0059] 

The IP connection establishing unit 52 establishes two connections, an inbound 
socket connection and an outbound socket connection, to and from the analog signal 
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output device 70. The control signal processing unit 53 sends control signals to the 
analog signal output device, as described in detail below. The IP connection 
disconnecting unit 54 disconnects the inbound socket connection and outbound socket 
connection after input has been completed. 
[0060] 

The analog signal output device 70 has a network controller 61 connected to the 
network and also includes an IP connection establishing unit 62 on the terminal side, a 
control signal processing unit 63, a signal receiving unit 71 for accepting digital signals 
from the personal computer, a D/A converter 72 for converting the digital signals into 
analog signals, and an output unit 73 for outputting the analog signals, centered around 
the network controller 61. 

It is also possible to provide a buffer area 74 and data requesting unit 75 for 
buffer control. 
[0061] 

A speaker is connected to the output unit 73, so data reproduced by the sound 
application 40 in the personal computer 50 can be output as voice. 
[0062] 

Next, processing by the application processing unit 55 will be described. FIG. 
5 shows an operation sequence of the sound application 40, virtual sound driver 41, 
buffer driver 42, and setting software 43 when voice is input from the microphone 44 
and recorded by the sound application 40. FIG. 6 also shows an operation sequence of 
the sound application 40, virtual sound driver 41, buffer driver 42, and setting software 
43 when voice data is generated by the sound application 40 and output from the speaker 
44. 

[0063] 

As illustrated in FIG. 5, when the sound application 40 starts recording 
processing, the data information used by the sound application is passed from the virtual 
driver 41 to the buffer driver 42. Format setting and setting processing (fmt setting and 
display) for data transfer are then carried out. In this embodiment, format setting 
functions passed to the buffer driver include a wave format pointer, which is placed at 
the beginning, a representation format, channel information, a sampling frequency, the 
amount of data transferred, a block size, and the number of bits per sample. 
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[0064] 

RUN processing is performed as state notification processing when, for 
example, recording is started. At that time, a KSRUN_STATE function for 
reproduction or recording is sent. Whether the function is intended for reproduction or 
recording is discriminated by an argument. The buffer driver 42 sends a state event 
notification to the setting software upon occurrence of a state change in the buffer driver 
42. Upon receipt of this event notification, the setting software 43 obtains the state 
from the buffer driver. 
[0065] 

Other state notification processing includes KSSTOP^STATE (stop), 
KSPAUSEJSTATE (temporary stop), and KSSTATE ACQUIRE (resource having been 
acquired). After a setting has been made, processing is usually performed in the 
following sequence in reproduction or recording processing: KSPAUSE STATE -> 
KSRUN STATE KSSTOP_STATE. 
[0066] 

During execution of RUN, a data transfer area that has been set is used to 
transfer reproduced or recorded data by a preset amount at preset time intervals. 
[0067] 

Unlike ordinary sound devices, this system causes an incorrect data transfer 
timing because data transfer position and transfer interrupts are not supported by 
hardware. To prevent input/output data discontinuity due to the incorrect timing, the 
speed and the amount of data transferred are adjusted by, for example, the ratio of the 
contents of the buffer capacity provided in the buffer driver. 
[0068] 

FIG. 7 shows the structure of the buffer driver 42. The buffer driver 42 has an 
interface function used between the IOCTL 81 and the data buffer 80, which is a wave 
data storage area, and also has a notification function for reporting a state change event 
82, so that data is transmitted and received between the virtual sound driver 41 and 
setting software 43. As described above, the setting software is notified of the state 
change event 82 through an event notification, according to the state change notification 
from the virtual sound driver. In buffer management, write points and read points in the 
virtual sound driver and setting software are controlled by flags. 
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[0069] 

The setting software 43 in this embodiment is created as an application that 
resides in the operating system when activated and performs packet communication with 
the analog signal input/output device 30 when a setting change is made by the graphical 
user interface (GUI) and an event notification is received from the buffer driver. A GUI 
screen processing program and an event notification receiving thread are always 
running. 
[0070] 

The GUI can be used for setting IP addresses of devices, time-out periods 
during volume setting in reproduction and recording, and the number of retries. 
[0071] 

This completes the description of the processing by the application processing 
unit 55. Next, a procedure for transmitting and receiving data to and from the analog 
signal input/output device 30 through the network 20 will be described. 
[0072] 

In the present invention, two sockets, an outbound socket specific to outbound 
information and an inbound socket specific to inbound information, are provided 
between the personal computer 10 and analog signal input/output device 30. The 
outbound socket sends a command or data as an outbound message. A receiving port 
with a port number, for example, 47474 is provided on the analog signal input/output 
device 30. 
[0073] 

Then, an inbound message is used to return a status as a response. The 
inbound socket sends a command or data as an inbound message. Then, an outbound 
message is used to return a status. A receiving port with a port number, for example, 
41414 is provided on the personal computer 10. 
[0074] 

These sockets are connected as follows: when the outbound socket is connected 
by the IP connection establishing unit 52 in the personal computer 10, the inbound socket 
is connected by the IP connection establishing unit 62 in the analog signal input/output 
device 30. 
[0075] 
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In the present invention, as described above, the inbound socket and outbound 
socket are connected independently. When the inbound socket and outbound socket are 
selectively used to send and receive data and commands as described below, therefore, 
stable signal input/output is achieved without data transfer congestion. 
[0076] 

The inbound socket and outbound socket are disconnected by the IP connection 
disconnecting unit 54 in the personal computer 10. 
[0077] 

At the time of recording, the outbound socket is first used to send an EXIST 
command that checks for the presence or absence of the analog signal input/output 
device 30 and initializes it, as shown in FIG. 8. If the result is normal, the analog signal 
input/output device 30 returns a normal status. Similarly, a recording volume setting 
command and recording start command are sent and then the analog signal input/output 
device 30 returns a normal status. 
[0078] 

These commands are all sent from the control signal processing unit 53 in the 
personal computer 10. The control signal processing unit 63 in the analog signal 
input/output device 30 performs response processing. 
[0079] 

Upon receipt of the above recording start signal, an analog signal entered from 
the analog signal input unit 64, to which a microphone is connected, is converted by the 
AID converter 65 into a digital signal. The digital signal then passes through the signal 
transmitting unit 66 and network controller 61 as recorded data and is transmitted over 
the inbound socket 
[0080] 

The data length of recorded data is set according to the data speed in the format 
setting described above. When the data speed is, for example, less than 16 Kbytes/s, 
the data length is set to 8,192 bytes; similarly, at data speeds of less than 32 Kbytes/s and 
32 Kbytes/s or more, the data length is set to 16,384 bytes and 32,768 bytes, respectively. 
Data is waveform data that can be processed by the application. 
[0081] 

Each time the application processing unit 55 in the personal computer 10 
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receives recorded data, it returns a normal or abnormal status over the inbound socket. 
[0082] 

If, for example, a recording volume is set by the sound application 40 during 
this recording processing, a recording volume setting command is sent from the control 
signal processing unit 53 over the outbound socket. The command is processed by the 
control signal processing unit 63 in the analog signal input/output device 30 and a 
response is returned. The command is reflected in, for example, signal intensity 
adjustment by the analog signal input unit 64. 
[0083] 

Upon the completion of recording, a recording stop command is sent over the 
outbound socket. Then, the A/D converter 65 and signal transmitting unit 66 are 
stopped according to a command received from the control signal processing unit 63. 
Data received after the recording stop command can be sent to the personal computer 10 
and discarded by the application processing unit 55. Finally, after a normal status is 
sent to the analog signal input/output device 30 over the inbound socket, the inbound 
socket and outbound socket are disconnected. 
[0084] 

Next, a transmission procedure at the time of reproduction from the speaker will 
be described with reference to FIG. 9. In the present invention, a buffer area 74 and 
data requesting unit 75 can be provided in the analog signal output device, enabling 
continuous analog signal output. 
[0085] 

When the sound application 40 starts reproduction processing, the outbound 
socket is used to send an EXIST command that checks for the presence or absence of the 
analog signal input/output device 30 and initializes it, as described above. If the result 
is normal, the analog signal input/output device 30 returns a normal status. Similarly, a 
reproduction volume setting command and reproduction start command are sent and then 
the analog signal input/output device 30 returns a normal status. 
[0086] 

These commands are all sent from the control signal processing unit 53 in the 
personal computer 10. The control signal processing unit 63 in the analog signal 
input/output device 30 performs response processing. 
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[0087] 

Then, reproduced data of voice is sent to the analog signal input/output device 
30 over the outbound socket. In the analog signal input/output device 30, digital data 
received by the signal receiving unit 71 is accumulated in the buffer area 74; at the same 
time, the digital data is converted by the D/A converter 72 into analog signals and the 
analog signals are output from the speaker connected to the output unit 73 as voice. 
[0088] 

If there is an available space in the buffer area after reproduced data is received, 
the control signal processing unit 63 returns a normal status that indicates there is an 
available space in the buffer area. When the control signal processing unit 53 in the 
personal computer 10 receives that status, reproduced data from the application 
processing unit 55 is sent by the signal transmitting unit 56. 
[0089] 

If the buffer area 74 is full of data and no more reproduced data can be 
accumulated in the buffer area, a normal status that indicates there is no available space 
is returned. When this happens, transmission from the signal transmitting unit 56 is 
suspended and the overflowing data is stored in, for example, the memory in the personal 
computer or an external storage device. 
[0090] 

When data in the buffer area 74 is reduced as a result of voice output and an 
available space equal to or greater than the length of a reproduced data block is created in 
the buffer area, the data requesting unit 75 sends a reproduced data request command 
over the inbound socket. Upon receipt of the command, the control signal processing 
unit 53 returns a normal status over the inbound socket and commands the signal 
transmitting unit 56 to send reproduced data again over the outbound socket. This 
sequence is repeated so that voice is output while a predetermined amount of data is 
accumulated in the buffer area 74. 
[0091] 

A reproduction volume setting command can be sent in the middle over the 
outbound socket. The analog signal input/output device 30 then returns a normal status. 
[0092] 

If there is no reproduced data remaining in the buffer, the control signal 



19 



processing unit 63 in the analog signal input/output device 30 sends a reproduced data 
empty command over the inbound socket. The reproduced data empty command 
indicates that there is no data remaining; if a reproduction stop command is not received 
and the empty state continues, the reproduced data empty command is sent repeatedly at 
10-second intervals. 
[0093] 

When stopping the reproduction, the personal computer 10 sends a reproduction 
stop command over the outbound socket. When the analog signal input/output device 
30 responds with a normal status, the reproduction processing is terminated. 
[0094] 

The present invention uses TCP/IP, so commands and data are assigned serial 
numbers so that correct orders are maintained during recording and reproduction and that 
a correct sequence of commands is assured. Specifically, each time an inbound or 
outbound message is sent, the transmitting side adds an ascending serial number. Since 
the serial number is used in the response status, the transmitting side is notified of the 
command that has been sent normally. 
[0095] 

As described above, the present invention can use an analog signal input/output 
device connected to a host computer via a network to input and output any kind of 
analog signals to and from the host computer. When analog signal input/output devices 
are each assigned unique IP addresses, the host computer can freely select a desired 
analog signal input/output device just by specifying its IP address. 
[0096] 

As described above, a microphone and speaker are typical devices that use 
analog signals. Since analog signals output from various types of sensors, measuring 
instruments, and the like are input, devices that have needed to be physically connected 
can be used. 
[0097] 

In particular, when a wireless LAN, mobile phone line, personal handyphone 
system (PHS) line, or other network is used, the host computer and analog signal 
input/output devices can be disposed in desired positions. 
[0098] 
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For example, a standalone speaker with no speaker cord can be configured just 
by including the analog signal input/output device (particularly the output device) in a 
speaker and mounting a wireless LAN adapter on the network controller. If speakers of 
this type are disposed in a plurality of places in a home or the like, a speaker for output 
can be specified at any time from a single personal computer. 
[0099] 

As described above, the present invention provides an extremely versatile 
input/output device. The device may be provided as an independent unit having analog 
input and output terminals and may also be integrally combined with another device that 
generates and outputs analog signals. 

Second Embodiment 
[0100] 

An arrangement for stereo voice input and output according to the present 
invention will be described below. FIG. 10 shows sockets 103 with a port number 
47474 for voice data transmitted and received between a host computer 100 and two 
analog signal input/output devices 101 and 102. In the present invention, another 
socket 104 with the port number 41414, as a dedicated socket for control, is provided 
separately from the sockets for voice data so as to enable control signals and response 
signals to be transmitted and received, as shown in FIG. 11. The control signals include 
signals for a search for the analog signal input/output device on the network, for starting 
recording, and for stopping recording. The response signals include responses to the 
above search, the starting of recording, and the stopping of recording. 
[0101] 

The User Datagram Protocol (UDP) is used as the transport protocol. 

[0102] 

In the UDP protocol, an IP packet is included in a UDP packet. A standard 
UDP packet header includes a source port number, a destination port number, a message 
length, a checksum, and data. In practice, there is no significant difference between the 
UDP packet and IP packet. 
[0103] 

In this embodiment, the UDP protocol is used to send, by including in the 
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header, a volume, a voice level, a sampling rate, the number of bits per sample, and other 
characteristic information required for reproduction or recording. Accordingly, benefits 
resulting from the use of the high-end protocol for IP packets are provided; for example, 
a quick response to modification of voice data output from the personal computer is 
made possible. 
[0104] 

FIG. 12 shows the structure of voice data. A first one byte is a command 
indicating voice data, followed by the number of channels (monophonic or stereophonic) 
represented by one bit, the number of bits per sample, a volume, a sampling rate, and a 
data length in that order, as shown in the drawing. Finally, PCM data for one frame is 
sent. 
[0105] 

In this embodiment, one frame of PCM data is data for 10 ms, but not fixed to 
this length. If the data length exceeds 512 bytes, the data is sent in a plurality of packets 
with the maximum packet length being 512 bytes. When the data length is 888 bytes, 
with an 882-byte frame and a 6-byte header, for example, the data is sent in two packets; 
the first packet is 512-byte long and the second packet is 376-byte long. When 
transmission is directed to the right and left channels, the first packet and the second 
packet are sent sequentially in that order. 
[0106] 

FIG. 13 shows the entire structure of the analog signal input/output device 101. 
The analog signal input/output device 101 has a network controller 110 connected to a 
LAN, the Internet, or another network, a CPU 1 11, a voice processing circuit 1 12, a D/A 
converter 1 13, and an AID converter 1 14. A speaker 1 1 5 and microphone 116 are also 
attached. The speaker 1 1 5 and microphone 1 1 6 may be connectable though external 
terminals, instead of being attached. 
[0107] 

The CPU 1 1 1 is responsible for data transmission between the LAN and voice 
processing circuit 1 12 and device state management. The voice processing circuit 112 
is responsible for voice data buffering, D/A and AID conversion control, synchronization 
control, and volume control, as described below. 
[0108] 



22 



After writing voice data into the voice processing circuit 1 12, if the data is valid, 
the CPU 1 1 1 terminates the processing by writing in succession a state (discrimination of 
left channel reproduction, right channel reproduction, the starting of recording, the 
stopping of recording, etc.), a frame length, a sampling rate, the number of channels, the 
number of bits, and a volume, and, finally, setting a flag (a prescribed bit string) 
indicating the data is valid. 
[0109] 

FIG. 14 shows a block diagram that indicates the structure of the voice 
processing circuit 112. A decoder 122 connected to the CPU 111 via address buses 120 
and 121, which are physical signal lines, retrieves the above control signals and voice 
data and transmits them to a volume transferring unit 123, a primary voice data buffer 
124, and a controller 125. In the volume transferring unit 123, an electronic volume 
control (not shown) changes a reproduced volume according to volume control 
information. 
[0110] 

The voice data is continuously transferred from a primary buffer 124 through a 
transferring unit 126 to a main buffer 127. 
[0111] 

Although the data stored in the main buffer 127 has been conventionally 
converted directly from digital to analog and output, a novel synchronization mechanism 
is provided in the present invention. The host computer and the voice input/output 
devices each have a different clock source. In the analog signal input/output device 101 
as well, a sampling clock generator 128 oscillates a specific clock. In particular, the 
virtual sound driver in the host computer (personal computer) uses a software timer to 
create data processing cycles, so there is large error. Data speeds even at the same 
sampling frequency differ slightly, possibly causing discontinuous sound and increasing 
a phase shift between the right and left stereo channels. To address this problem, the 
present invention has achieved synchronization control by adjusting the data speeds to 
the data speed on the transmitting side. 
[0112] 

Specifically, lower and upper thresholds are preset for the amount of remaining 
data in the main buffer 127. The controller 125 checks and retrieves the remaining data 
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amount for each valid data indicating signal described above. 
[0113] 

If the remaining data amount falls below the lower threshold, the controller 125 
performs control so that the sampling clock is decreased by one step and then 
transmission is performed from a DA/AD transmitting unit 129 through a D/A data 
parallel/serial converter 130 to the D/A converter 113. 
[0114] 

If the upper threshold is exceeded, the sampling clock is increased by one step 
and transmission is performed similarly. If the amount of remaining data is returned to 
within the appropriate range, control is performed so that the sampling clock is returned 
to the original clock. 
[0115] 

When the sampling clock is at 44,100 Hz, for example, if the system clock 
generated by the sampling clock generator 128 is at 45.1584 MHz, the 44,100-Hz 
frequency is usually obtained by dividing the system clock frequency by 512 x 2 cycles. 
In control for lowering the frequency by one step, the system clock frequency is divided 
by 513* 2 cycles, resulting in 44,0 14Hz. In control for increasing the frequency by one 
step, the system clock frequency is divided by 511* 2 cycles, resulting in 44,186 Hz. 
[0116] 

The variable ratio of the sampling clock is only about 0.2%, which does not 
largely affect the sound quality. Accurate synchronization is achieved as much as 
possible by minimizing the difference between the upper and lower thresholds (reducing 
the difference to about one frame). 
[0117] 

The data valid signal is issued by the CPU 1 1 1 after voice data for one frame has 
been written. However, the voice data includes fluctuating components such as 
collision delays and processing delays by the task switch and LAN card in the host 
computer and the driver. If the remaining data amount described above is determined 
only in one decision, the measurement result is not accurate due to the large effect by the 
fluctuating components. 
[0118] 

To reduce the effect by the fluctuating components, when the remaining amount 
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of data is retrieved, an average of the last 32 measurements is used as the amount of 

currently remaining data. 

[0119] 

These measurements are performed by the controller 125. The controller 125 
stores the last 32 measurements and calculates an average. 
[0120] 

The synchronization mechanism described above assures that the amount of 
remaining data is always fixed even for stereo voice, making the speeds of the outputs 
from the voice input/output devices equal to the speed on the transmitting side. As a 
result, phase synchronization is established, eliminating the need to perform phase 
control separately. 
[0121] 

The initial phase difference is determined according to processing time 
differences caused by unicasting for a plurality of voice input/output devices and mainly 
to differences in time taken to transmit to the Ethernet (trademark). At a frequency of 
44,100 Hz, for example, suppose that data for one frame is sent in two packets, the first 
packet being 5 12-byte long. Then, the time difference when the 512-byte packet is 
unicasted is 41/xs (512 x 8/100,000,000) for 100Base-TX; if transmission to the Ethernet 
and delays to prevent collision are considered, the time difference is about 50/xs. The 
phase difference between the right and left channels is 50/is, equivalent to an acoustic 
velocity of 1 .7c/m. Therefore, the initial phase difference can be reduced to a degree at 
which there is no problem when the speakers are disposed in a usually way. 
[0122] 

Since the reproduction speeds are synchronized by the synchronization control 
mechanism as described above, voice outputs from a plurality of voice input/output 
devices are synchronized with the initial phase difference left unchanged. 
Environments for 5.1 -channel, 6.1 -channel, and 7.1 -channel speakers, in which stereo 
voice output and surround environments are achieved, can be configured exactly in the 
same way. 
[0123] 

The main buffer 127 has a minimum required capacity (about four frames) as 
shown in the drawing. This minimizes the delay and thereby enables linkage with 
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real-time applications and other devices. 

This embodiment uses Power Over Ethernet (PoE) to supply power to the 
analog signal input/output device 101 so that it can be disposed easily. Also, to 
simplify settings, the analog signal input/output device is designed so that it responds 
with it address and other information when the host computer searches for it on the LAN. 
The speakers are listed in a group setting GUI (for right and left speaker settings) in a 
transfer application. The GUI enables the setting of output destination, information 
about the right and left speakers, volume, and the like just by selecting from the list. 
[0124] 

The analog signal input/output device can also send voice entered from the 
microphone to the network, as described above. When the receiver is the host computer, 
the voice is handled as an input that has been passed through a virtual sound device, as in 
the case of output. Accordingly, the voice can be used as a voice input to various 
applications. It is also possible to use the device on the receiving side as another voice 
input/output device (for example, 102) without the host computer being passed through. 
In this case, the terminal on the receiving side receives voice by the same method 
described above. A system for interphones can also be configured just by connecting 
simple devices of this type to a LAN. 

Third Embodiment 
[0125] 

FIG. 15 shows an arrangement in which a remote control terminal 130 is 
provided on the network to control the host computer 100. 
[0126] 

In addition to the socket specific to voice data and the socket specific to control 
described above, this arrangement further uses an operation socket for remote control. 
The operation socket is connected based on TCP; it uses a port number 43434, for 
example. 
[0127] 

The remote control terminal 450 j_31 has a speaker selecting switch and volume 
changing switch; when the speaker selecting switch is pressed, specification information 
about a voice input/output device is sent to the host computer; when the volume 
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changing switch is pressed, volume setting information is sent to the host computer. 
The information sent by the switches is a bit string comprising a command and a data 
length as well as information about the name of a voice input/output device to be 
activated or a volume setting value. The information is sent from a known network 
adapter through the network. 
[0128] 

In the host computer, the network adapter receives the information, and the 
control signal processing unit sends a control signal according to the received 
information. 
[0129] 

The remote control terminal can select an output destination and adjust the 
volume at an appropriate place, independently of the voice input/output device and host 
computer, so the remote control terminal is particularly useful when used in conjunction 
with the voice input/output device according to the present invention. 
[0130] 

The remote control function can also be attached to the voice input/output 
device. In this case, control which has been performed by the host computer can be 
specified from a desired voice input/output device. When the user moves from a room 
to another room, for example, the output destination can be changed to the voice 
input/output device in the other room. In particular, the remote control function can be 
preferably combined with the arrangement for interphones described above, in which 
case an output can be directed directly to a desired terminal. 
[0131] 

Furthermore, an infrared light receiving element is attached to the voice 
input/output device, the host computer, or the remote operation terminal described above 
so that remote operation can be performed from an infrared remote control. 
Another Embodiment 
[0132] 

In the above embodiments, arrangements using wired and wireless LANs and 
the Internet have been disclosed. A preferable arrangement will be obtained by using 
IEEE 802.1 le compatible wireless LANs. According to the standard, Quality of 
Service (QoS) is achieved, so packet fluctuations described above are eliminated. Since 
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averaging processing is thereby not necessary, more complete synchronization and phase 

synchronization become possible. 

[0133] 

A wireless universal serial bus (USB) may be used for short-distance signal 
transmission. The present invention is not necessarily limited to voice; it can be applied 
to input and output of all types of analog signals. Accordingly, the arrangement may be 
such that signals are transmitted and received to and from peripheral units over a USB. 
[0134] 

Examples of analog signals that can be used in the present invention include 
analog signals, signals for adjusting the illumination intensity of lamps and the 
temperatures of heating wires, and arbitrary signals actuated by time-series harmonics. 
[0135] 

Although PoE is used in the second embodiment to supply power, any power 
supply method can be used. If solar cells are used in conjunction with a wireless LAN, 
a completely wireless voice input/output device can be provided. 
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